Measuring the quality of teaching in elementary school classrooms

This paper reviews the means by which teacher quality has been measured. It considers data sources such as students, peers, experts, and examines the psychometrics and scaleproperties of teacher quality assessment instruments with respect to reliability and validity. A list of items for possible inclusion in an elementary student focussed instrument is considered, together with the potential use of such an instrument in measuring teacher quality.

Psychometric validation of the growth and empowerment measure (GEM) applied with Indigenous Australians

Objective: Empowerment is a complex process of psychological, social, organizational and structural change. It allows individuals and groups to achieve positive growth and effectively address the social and psychological impacts of historical oppression, marginalization and disadvantage. The Growth and Empowerment Measure (GEM) was developed to measure change in dimensions of empowerment as defi ned and described by Aboriginal Australians who participated in the Family Well Being programme.---------- Method: The GEM has two components: a 14-item Emotional Empowerment Scale (EES14) and 12 Scenarios (12S). It is accompanied by the Kessler 6 Psychological Distress Scale (K6), supplemented by two questions assessing frequency of happy and angry feelings. For validation, the measure was applied with 184 Indigenous Australian participants involved in personal and/or organizational social health activities.---------- Results: Psychometric analyses of the new instruments support their validity and reliability and indicate two-component structures for both the EES (Self-capacity; Inner peace) and the 12S (Healing and enabling growth, Connection and purpose). Strong correlations were observed across the scales and subscales. Participants who scored higher on the newly developed scales showed lower distress on the K6, particularly when the two additional questions were included. However, exploratory factor analyses demonstrated that GEM subscales are separable from the Kessler distress measure.---------- Conclusion: The GEM shows promise in enabling measurement and enhancing understanding of both process and outcome of psychological and social empowerment within an Australian Indigenous context.

Responsiveness of the Effective Consumer Scale (EC-17)

Objective. The Effective Consumer Scale (EC-17) comprises 17 items measuring the main skills and behaviors people need to effectively manage their healthcare. We tested the responsiveness of the EC-17. Methods. Participants, in 2 waves of a 6-week Arthritis Self-Management Program (ASMP) from Arthritis Ireland, received a questionnaire at the first and last week of the weekly ASMP. The questionnaire included the EC-17 and 10 other measures for arthritis. Deficits, mean change, and standard deviations were calculated at baseline and Week 6. The EC-17 scores were compared to the Arthritis Self-Efficacy (ASE) and Patient Activation Measure (PAM) scales. Results were presented at OMERACT 9. Results. There is some overlap between the EC-17 and the ASE and PAM; however, most items of greatest deficit in the EC-17 are not covered by those scales. In 327 participants representing both intervention waves (2006 and 2007), the EC-17 was more efficient than the ASE but less efficient than the PAM for detecting improvements after the ASMP, and was moderately correlated with the PAM. Conclusion. The EC-17 appears to measure different skills and attributes than the ASE and PAM. Discussions with participants at OMERACT 9 agreed that it is worthwhile to measure the skills and attributes of an effective consumer, and supported the development of an intervention (such as proposed online decision aids) that would include education in the categories in the EC-17.

Using the Depression Anxiety Stress Scale 21 (DASS-21) across cultures

DASS-21 has been validated in a number of populations such as Hispanic adults, American, British and Australian. The findings show that the DASS-21 is psychometrically sound with good reliability and validity. It is clear from the literature that the DASS-21 is a well established instrument for measuring depression, anxiety and stress in the Western world. Nonetheless, the lack of appropriate validation amongst Asian populations continues to pose concerns over the use of DASS-21 in Asian samples. Cultural variation may influence the individual’s experience and emotional expression. Thus, when researchers and practitioners employ Western-based assessments with Asian populations by directly translating them without an appropriate validation, the process can be challenging. In summary, we have conducted a series of rigorous statistical tests and minimised any potential confounds from the demographic information. The advantages of this revised DASS-18 stress scale are twofold. First, the revised DASS-18 stress scale possessed fewer items, which resulted in a cleaner factorial structure. Second, it also had a smaller inter-factor correlation. With these justifications, the revised DASS-18 stress scale is potentially more suitable for the Asian populations.

The ECOS Project. An interactive simulation to promote an ECO-friendly universe.

Custom designed for display on the Cube Installation situated in the new Science and Engineering Centre (SEC) at QUT, the ECOS project is a playful interface that uses real-time weather data to simulate how a five-star energy building operates in climates all over the world. In collaboration with the SEC building managers, the ECOS Project incorporates energy consumption and generation data of the building into an interactive simulation, which is both engaging to users and highly informative, and which invites play and reflection on the roles of green buildings. ECOS focuses on the principle that humans can have both a positive and negative impact on ecosystems with both local and global consequence. The ECOS project draws on the practice of Eco-Visualisation, a term used to encapsulate the important merging of environmental data visualization with the philosophy of sustainability. Holmes (2007) uses the term Eco-Visualisation (EV) to refer to data visualisations that ‘display the real time consumption statistics of key environmental resources for the goal of promoting ecological literacy’. EVs are commonly artifacts of interaction design, information design, interface design and industrial design, but are informed by various intellectual disciplines that have shared interests in sustainability. As a result of surveying a number of projects, Pierce, Odom and Blevis (2008) outline strategies for designing and evaluating effective EVs, including ‘connecting behavior to material impacts of consumption, encouraging playful engagement and exploration with energy, raising public awareness and facilitating discussion, and stimulating critical reflection.’ Consequently, Froehlich (2010) and his colleagues also use the term ‘Eco-feedback technology’ to describe the same field. ‘Green IT’ is another variation which Tomlinson (2010) describes as a ‘field at the juncture of two trends… the growing concern over environmental issues’ and ‘the use of digital tools and techniques for manipulating information.’ The ECOS Project team is guided by these principles, but more importantly, propose an example for how these principles may be achieved. The ECOS Project presents a simplified interface to the very complex domain of thermodynamic and climate modeling. From a mathematical perspective, the simulation can be divided into two models, which interact and compete for balance – the comfort of ECOS’ virtual denizens and the ecological and environmental health of the virtual world. The comfort model is based on the study of psychometrics, and specifically those relating to human comfort. This provides baseline micro-climatic values for what constitutes a comfortable working environment within the QUT SEC buildings. The difference between the ambient outside temperature (as determined by polling the Google Weather API for live weather data) and the internal thermostat of the building (as set by the user) allows us to estimate the energy required to either heat or cool the building. Once the energy requirements can be ascertained, this is then balanced with the ability of the building to produce enough power from green energy sources (solar, wind and gas) to cover its energy requirements. Calculating the relative amount of energy produced by wind and solar can be done by, in the case of solar for example, considering the size of panel and the amount of solar radiation it is receiving at any given time, which in turn can be estimated based on the temperature and conditions returned by the live weather API. Some of these variables can be altered by the user, allowing them to attempt to optimize the health of the building. The variables that can be changed are the budget allocated to green energy sources such as the Solar Panels, Wind Generator and the Air conditioning to control the internal building temperature. These variables influence the energy input and output variables, modeled on the real energy usage statistics drawn from the SEC data provided by the building managers.

Quality of life and survival in patients treated with radical chemoradiation alone for oesophageal cancer

Aims: To report cancer-specific and health-related quality-of-life outcomes in patients undergoing radical chemoradiation (CRT) alone for oesophageal cancer. Materials and methods: Between 1998 and 2005, 56 patients with oesophageal cancer received definitive radical CRT, due to local disease extent, poor general health, or patient choice. Data from European Organization for Research and Treatment of Cancer quality-of-life questionnaires QLQ-30 and QLQ-OES24 were collected prospectively. Questionnaires were completed at diagnosis, and at 3, 6 and 12 months after CRT where applicable. Results: The median follow-up was 18 months. The median overall survival was 14 months, with a 51, 26 and 13% 1-, 3- and 5-year survival, respectively. At 12 months after treatment there was a significant improvement compared with before treatment with respect to dysphagia and pain. Global health scores were not significantly affected. Conclusions: Considering the relatively short long-term survival for this cohort of patients, maximising the quality of those final months should be very carefully borne in mind from the outset. The health-related quality-of-life data reported herein helps to establish benchmarks for larger evaluation within randomised clinical trials. © 2007 The Royal College of Radiologists.

Factors associated with physical activity in children attending family child care homes

Objective To determine the relationship between family child care home (FCCH) practices and characteristics, and objectively measured physical activity (PA) among children attending FCCHs. Methods FCCH practices and characteristics were assessed in 45 FCCHs in Oregon (USA) in 2010-2011 using the Nutrition and Physical Activity Self-Assessment for Child Care Instrument. Within the 45 FCCHs, 136 children between ages 2 and 5. years wore an accelerometer during child care attendance over a one-week period. Time spent in light, moderate, and vigorous PA per hour was calculated using intensity-related cut-points (Pate et al., 2006). Results FCCH characteristics and practices associated with higher levels of PA (min/h; p < 0.05) included provision of sufficient outdoor active play [32.2 (1.0) vs. 28.6 (1.3)], active play using portable play equipment [31.7 (1.0) vs. 29.3 (1.4)], the presence of a variety of fixed play equipment [32.2 (1.0) vs. 28.9 (1.3)], and suitable indoor play space [32.2 (1.0) vs. 28.6 (1.3)], engaging in active play with children [32.1 (1.1) vs. 29.6 (1.2)], and receiving activity-related training [33.1 (1.2) vs. 30.3 (1.1)]. Conclusions This is the first study to identify practices and characteristics of FCCHs that influence children's PA. These data should be considered when developing programs and policies to promote PA in FCCHs.

Cross cultural adaptation and validation of a Spanish version of the lower limb functional index

Background: The Lower Limb Functional Index (LLFI) is a relatively recently published regional outcome measure. The development article showed the LLFI had robust and valid clinimetric properties with sound psychometric and practical characteristics when compared to the Lower Limb Extremity Scale (LEFS) criterion standard. Objective: The purpose of this study was cross cultural adaptation and validation of the LLFI Spanish-version (LLFI-Sp) in a Spanish population. Methods: A two stage observational study was conducted. The LLFI was initially cross-culturally adapted to Spanish through double forward and single backward translation; then subsequently validated for the psychometric characteristics of validity, internal consistency, reliability, error score and factor structure. Participants (n = 136) with various lower limb conditions of >12 weeks duration completed the LLFI-Sp, Western Ontario and McMaster University Osteoarthritis Index (WOMAC) and the Euroqol Health Questionnaire 5 Dimensions (EQ-5D-3 L). The full sample was employed to determine internal consistency, concurrent criterion validity, construct validity and factor structure; a subgroup (n = 45) determined reliability at seven days concurrently completing a global rating of change scale. Results: The LLFI-Sp demonstrated high but not excessive internal consistency (α = 0.91) and high reliability (ICC = 0.96). The factor structure was one-dimensional which supported the construct validity. Criterion validity with the WOMAC was strong (r = 0.77) and with the EQ-5D-3 L fair and inversely correlated (r = -0.62). The study limitations included the lack of longitudinal data and the determination of responsiveness. Conclusions: The LLFI-Sp supports the findings of the original English version as being a valid lower limb regional outcome measure. It demonstrated similar psychometric properties for internal consistency, validity, reliability, error score and factor structure.

The mechanical and inflammatory low back pain (MIL) index: development and validation

Abstract Background The purpose of this study was the development of a valid and reliable “Mechanical and Inflammatory Low Back Pain Index” (MIL) for assessment of non-specific low back pain (NSLBP). This 7-item tool assists practitioners in determining whether symptoms are predominantly mechanical or inflammatory. Methods Participants (n = 170, 96 females, age = 38 ± 14 years-old) with NSLP were referred to two Spanish physiotherapy clinics and completed the MIL and the following measures: the Roland Morris Questionnaire (RMQ), SF-12 and “Backache Index” (BAI) physical assessment test. For test-retest reliability, 37 consecutive patients were assessed at baseline and three days later during a non-treatment period. Face and content validity, practical characteristics, factor analysis, internal consistency, discriminant validity and convergent validity were assessed from the full sample. Results A total of 27 potential items that had been identified for inclusion were subsequently reduced to 11 by an expert panel. Four items were then removed due to cross-loading under confirmatory factor analysis where a two-factor model yielded a good fit to the data (χ2 = 14.80, df = 13, p = 0.37, CFI = 0.98, and RMSEA = 0.029). The internal consistency was moderate (α = 0.68 for MLBP; 0.72 for ILBP), test-retest reliability high (ICC = 0.91; 95%CI = 0.88-0.93) and discriminant validity good for either MLBP (AUC = 0.74) and ILBP (AUC = 0.92). Convergent validity was demonstrated through similar but weak correlations between the ILBP and both the RMQ and BAI (r = 0.34, p < 0.001) and the MLBP and BAI (r = 0.38, p < 0.001). Conclusions The MIL is a valid and reliable clinical tool for patients with NSLBP that discriminates between mechanical and inflammatory LBP. Keywords: Low back pain; Psychometrics properties; Pain measurement; Screening tool; Inflammatory; Mechanical

Leadership to support quality improvement in Vietnamese higher education

The impetus for the study reported in this paper is the Higher Education (HE) reform agenda outlined by the Vietnamese Ministry of Education and Training (MOET). The paper reports on phase one of a mixed method research; a quantitative approach using the Multifactor Leadership Questionnaire (MLQ) to investigate the Vietnamese HE leaders’ leadership styles. The MLQ survey was administered to approximately 190 senior managers in State HE institutions in Mekong Delta region in Vietnam (nine of colleges). The psychometrics of the MLQ for the Vietnamese sample confirmed the reliability and validity of the instrument with a Cronbach’s alpha of 0.779. A CFA was conducted and all factor structures were stable and consistent. The demographic variables were used to analyse patterns of leadership behaviours by the different sub-groups. The findings suggest that leaders who have different educational background and different gender in Mekong Delta region, Vietnam do not differ significantly in their perceptions about leadership factors.

Validation and reliability of a Spanish version of Simple Shoulder Test (SST-Sp)

Background: The Simple Shoulder Test (SST-Sp) is a widely used outcome measure. Objective: The purpose of this study was to develop and validate a Spanish-version SST (SST-Sp). Methods: A two-stage observational study was conducted. The SST was initially cross-culturally adapted to Spanish through double forward and backward translation and then validated for its psychometric characteristics. Participants (n = 66) with several shoulder disorders completed the SST-Sp, DASH, VAS and SF-12. The full sample was employed to determine factor structure, internal consistency and concurrent criterion validity. Reliability was determined in the first 24–48 h in a subsample of 21 patients. Results: The SST-Sp showed three factors that explained the 56.1 % of variance, and the internal consistency for each factor was α = 0.738, 0.723 and 0.667, and reliability was ICC = 0.687–0.944. The factor structure was three-dimensional and supported construct validity. Criterion validity determined from the relationship between the SST-Sp and DASH was strong (r = −0.73; p < 0.001) and fair for VAS (r = −0.537; p < 0.001). Relationships between SST-Sp and SF-12 were weak for both physical (r = −0.47; p < 0.001) and mental (r = −0.43; p < 0.001) dimensions. Conclusions: The SST-Sp supports the findings of the original English version as being a valid shoulder outcome measure with similar psychometric properties to the original English version.